Kolmogorov Complexity and Information Content
نویسنده
چکیده
In this paper, we revisit a central concept in Kolmogorov complexity in which one would equate program-size complexity with information content. Despite the fact that Kolmogorov complexity has been widely accepted as an objective measure of the information content of a string, it has been the subject of many criticisms including the fundamental one directed by logicians and philosophers towards the statistical and semantical theories of information, which is about confusing an object and its name. In this paper, we clarify a number of subtle issues that are at the center of this debate.
منابع مشابه
3D Scene and Object Classification Based on Information Complexity of Depth Data
In this paper the problem of 3D scene and object classification from depth data is addressed. In contrast to high-dimensional feature-based representation, the depth data is described in a low dimensional space. In order to remedy the curse of dimensionality problem, the depth data is described by a sparse model over a learned dictionary. Exploiting the algorithmic information theory, a new def...
متن کاملThe Kolmogorov complexity of infinite words
We present a brief survey of results on relations between the Kolmogorov complexity of infinite strings and several measures of information content (dimensions) known from dimension theory, information theory or fractal geometry. Special emphasis is laid on bounds on the complexity of strings in constructively given subsets of the Cantor space. Finally, we compare the Kolmogorov complexity to t...
متن کاملAlgorithmic “Kolmogorov” Complexity
The information content or complexity of an object can be measured by the length of its shortest description. For instance the string ‘01010101010101010101010101010101’ has the short description “16 repetitions of 01”, while ‘11001000011000011101111011101100’ presumably has no simpler description other than writing down the string itself. More formally, the Algorithmic “Kolmogorov” Complexity (...
متن کاملReliable Reductions High Sets and Low Sets
Measuring the information content of a set by the space bounded Kolmogorov complexity of its characteristic sequence we investigate the non uniform com plexity of sets A in EXPSPACE poly that reduce to some set having very high information content Speci cally we show that if the reducibility used has a certain property called reliability then A in fact is reducible to a sparse set under the sam...
متن کاملKolmogorov Complexity and Algorithmic Randomness
This paper aims to provide a minimal introduction to algorithmic randomness. In particular, we cover the equivalent 1-randomness and MartinLöf randomness. After a brief review of relevant concepts in computability, we develop the basic theory of Kolmogorov complexity, including the KC theorem and more general notion of information content measures. We then build two natural definitions of rando...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1710.06846 شماره
صفحات -
تاریخ انتشار 2017